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Abstract 

The evolutionary dynamics first conceived by Darwin and Wallace, referring to as 
Darwinian dynamics in the present paper, has been found to be universally valid in 
biology. The statistical mechanics and thermodynamics, while enormously success- 
ful in physics, have been in an awkward situation of wanting a consistent dynamical 
understanding. Here we present from a formal point of view an exploration of the 
connection between thermodynamics and Darwinian dynamics and a few related 
topics. We first show that the stochasticity in Darwinian dynamics implies the ex- 
istence temperature, hence the canonical distribution of Boltzmann-Gibbs type. In 
term of relative entropy the Second Law of thermodynamics is dynamically demon- 
strated without detailed balance condition, and is valid regardless of size of the 
system. In particular, the dynamical component responsible for breaking detailed 
balance condition does not contribute to the change of the relative entropy. Two 
types of stochastic dynamical equalities of current interest are explicitly discussed 
in the present approach: One is based on Feynman-Kac formula and another is 
a generalization of Einstein relation. Both are directly accessible to experimental 
tests. Our demonstration indicates that Darwinian dynamics represents logically a 
simple and straightforward starting point for statistical mechanics and thermody- 
namics and is complementary to and consistent with conservative dynamics that 
dominates the physical sciences. Present exploration suggests the existence of a 
unified stochastic dynamical framework both near and far from equilibrium. 
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One of the principle objects of theoretical research in any department of knowledge is to 
find the point of view from which the subject appears in its greatest simplicity. 

Josiah Willard Gibbs (1839-1903) 

I. INTRODUCTION 



A. What is Darwinian dynamics? 



n 



The dynamical theory proposed by Darwinian and Wallace yj; |2) on evolution in biology 
has formed the fundamental theoretical structure for understanding biological phenomena 
for one and half centuries. We refer to it in the present paper as "Darwinian dynamics". 
It has been confirmed by thousands and thousands of field observations and laboratory 
experiments, and extended to virtually all levels of biology. There is no known valid empirical 
evidence against it in biology, as in the same status of relativity and quantum mechanics 
in physics. There exists a concise and accessible discourse of this dynamics by a renowned 
researcher in physical sciences that we recommend to the reader (yl). Its essence may be 
summarized by a single word equation most familiar to biological scientists (jj): 



Evolution by Variation and Selection. 



In its initial formulation the theory was completely narrative. Not a single mathematical 
equation was used. There have been constant efforts by biologists and by others to clarify 



its meaning and to make it mo re q uantitative and hence more predictive 
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Q; 3; 16; 17; Q: 



17|; ll8|; H 



otners to cia riiy 

(B; S S S S H 



20|). Tremendous progress has been made during the 



past 100 years. Two of the most important concepts emerged in Darwinian dynamics are 



Fisher's fundamental theorem of natural selection 



which stresses the role of variation 
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in evolution, and Wright's adaptive landscape p), which describes the ultimate selection 
under a given condition as a potential function of a landscape in a gigantic genetic space. 
Nowadays the use of mathematics in this area is comparable to that of any mathematically 
sophisticated field of natural science. Darwinian dynamics is a bona fide nonequilibrium 
stochastic dynamical theory, which governs the processes leading to complex creatures such 
as Methenobacterium and Homo sapiens on Earth. 

What would be a possible mathematical structure for Darwinian dynamics? Though the 
scope of Darwinian dynamics is very broad and its quantification appears formidable, we will 
present here a precise and nevertheless general enough formulation. Intuitively evolution is 
about successive processes: Quantities at a later stage are related to their values at its earlier 
stage under both predictable (deterministic) and unpredictable (stochastic) constraints. For 
example, the world population of humans in next 20 years will be almost surely related to its 
current one. Hence, the genetic frequency, the probability in the population, of a given form 
of gene (allele) in the next generation is related to its present value. Here sexual conducts 
and other reproduction behaviors are treated as means to realize the variation and selection 
for evolution. We may denote those genetic frequencies as q with n components denoting all 
possible alleles. Thus = {qi,q2, ■■■,(ln) is a vector (Here r denotes the transpose). There 
are huge amount of human traits related to genetics (or genes): height, skin color, size of 
eye ball, faster runner, gene for liver cancer, gene for smartness, ... . The number n is 
then large: it could be as large, and likely larger, as the number of genes in human genome, 
which is about 20000, if one simply assigns one allele or a trait to one gene without any 
combinatory consideration. (This is certainly very crude. In addition, we do not know the 
exact way to specify such relationship yet). This number is far larger than the number of 
chemical elements, which is about 100, and than the number of elementary particles, about 
30. With a suitable choice of time scale equivalent to an averaging over many generations, 
the incremental rate in such an evolutionary process may be represented by a time deriva- 
tive, q = dq/dt. The deterministic constraint at a given time may be represented by a 
deterministic force f(q, t). For example, there is a high confidence to predict the eye color 
of a child based on the information from his/her parents, but the smartness of an offspring 
is not so strongly correlated to that of the parents. The random constraint, the unknown 
and/or irrelevant force, is approximated by a Gaussian-white noise term C{c[,t), with zero 
mean, {() = and the n x n variance matrix D: (C(q, t')C^{c[, t)) = 2D{q, t)66{t — t'). Here 
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the factor 2 is a convention and ^ is a positive numerical constant reserved for the role of 
temperature in physical sciences. 6{t) is the Dirac delta function. With these notations we 
are ready to transform the word equation into a precise mathematical equation, which now 
reads 

q = f(q,t)+C(q,t) • 



To physicists and chemists, this equation looks similar to an equation already known for 



100 years (|21 



22 



a), proposed by Langevin 50 years after Darwin and Wallace. There are 
some difficult issues in connection to the Langevin equation, such as the absence of detailed 
balance condition, to be discussed below. To mathematicians as well as biologists, it is in 
the form of standard formulation of stochastic differential equations (Q; Q)- We will return 
to above equation as Eq.(l) in next section. However, an immediate question arises: while 
we may represent the variation in evolution by the variance matrix D, where is Wright's 
adaptive landscape and the corresponding potential function? 

It is known that the deterministic force f(q, t) in general cannot be related to a po- 
tential function in a straightforward way, that is, f(q, t) 7^ — D(q, t) V0(q, t). Here 
V = {d/dqi,d/dq2, ....d/dqnY is the gradient operation in the phase space formed by q, 
and 0(q, t) is a scalar function. In fact, the existence of such a non-equality is ubiquitous 
in nonequilibrium processes. It is the breakdown of detailed balance. A nonequilibrium 
process typically has the following five qualitative characteristics: 

1) dissipative, V ■ f(q, t) 7^ 0; 

2) asymmetric, dfj{q,t)/dqi 7^ dfi{q,t)/dqj for at least one pair of indices of 

3) nonlinear, f(6'q, t) 7^ 9f{q,t); 

4) stochastic with multiplicative noise, D{q,t) depending on the state variable q; and 

5) possibly singular, that is, det{D{q,t)) = 0. 

The asymmetry is the reason that f(q, cannot be equal to — D(q, t)V0(q, t), which will 
become explicit below. These are the main reasons that a consistent formulation of nonequi- 



librium processes has been difficult ( l25l : l26l : 1271 : l28l: l29l). Progress in recent biological studies 



has shown that a quantitative Wright adaptive landscape is indeed embedded in the above 



stochastic differential equation 



in the physical sciences ( 1l9 
paper. 



30 



t emerges 



31 



32 



in a manner completely consistent with its use 



33I ). which will be explored further in the present 



6 



B. Outstanding questions on statistical mechanics and thermodynamics 



In the physical sciences there has been a sustainec 



nonequihbrium processes (|21 



25 



28 



29 



34 



interest during past several decades in 



35 



36l ). Important goals are to bridge 



its connection to equilibrium processes and to clarify the roles of entropy and the Second 
Law of thermodynamics within deterministic and conserved dynamics and to balance the 
descriptions between the single particle trajectory and the ensemble distribution. In this 
content we should also mention the enormous effort since Boltzmann to understand the 
associated direction of time from reversible dynamics (js^. 

There is also an active interest from the philosophical point of view on the foundations of 
statistical mechanics and thermodynamics (1381: l39l). Relevant to the present paper, following 
three fundamental questions have been explicitly formulated (1401 ): 
"In what sense can thermodynamics said to be reduced to statistical mechanics? 
"How can one derive equations that are not time-reversal invariant from a time- reversal 
invariant dynamics? 

"How to provide a theoretical basis for the 'approach to equilibrium' or irreversible pro- 
cesses?" 

In the view of the absence of logical consistent answers to abo ve q uestions from conserva- 



tive dynamics, Newtonian dynamics or quantum mechanics (|41 



42), it should be desirable 



to look into these problems from a completely different perspective. 



C. What can we learn from Darwinian dynamics? 



Thanks to recent progress in experimental technologies, particularly in nanotechnology, 
many previously inaccessible regimes in time and space are now actively been exploring. 



There have renewed interests in stochastic p 



M 
59 



3; 
60; 



48 



50 



5ll ). chemistry ( 



52|; 



53 



lenomena, ranging frorn physi cs (41 



54 



55l ) , material science ( 1561 : 1571 : l58l ) , biology ( 



43 



45; 
19; 



6ll ). and to other fields (]24j). These work demonstrate the strong on-going exchange 
of ideas between physical and biological sciences. In particular, quantitative experimental 
and theoretical physical methodologies have been finding their way into the study of cellular 
and molecular processes of life, which has been very useful. On the other hand, we think it 
is of at least equal value to consider the opposite direction of the flow of ideas. Darwinian 
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dynamics may generate new insights in the physical sciences. 

For example, Darwinian dynamics can address all three fundamental questions in pre- 
vious subsection in its own way. For the first question, as long as statistical mechanics is 
formulated according to the Boltzmann-Gibbs distribution, it will be shown below that Dar- 
winian dynamics indeed implies this distribution, and that the main structures of statistical 
mechanics and thermodynamics are equivalent. For the second question, it is found that 
thermodynamics is based on the energy conservation (the First Law) and on the Carnot 
cycle. It deals with quantities at equilibrium or steady state. There is no role for dynamics. 
Thus, there is no requirement for the direction of time: Both conservative and nonconser- 
vative dynamics can be consistent with it. The explicit independence of the Carnot cycle 
and the First Law on dynamical properties in Darwinian dynamics will become clear be- 
low. Hence, there is no conflict between thermodynamics and the time-reversal dynamics 
dominated in physics. For the third and last question, Darwinian dynamics comes with an 



adaptive behavior (Q; Q H; B 0; I; Q; Q; 



16 



17 



20) and with an intrinsically 



built-in direction of time. This is due to the explicitly stochastic or probabilistic nature of 
Darwinian dynamics. Such a behavior was summarized as the fundamental theorem of nat- 
ural selection (jsj) and extended further as the F-theorem (1^. Thus, Darwinian dynamics 
provides a general framework to address the question of " approaching to equilibrium" . 



D. Organization of the paper 

The rest of the paper is organized as follows. In section II Darwinian dynamics will be 
summarized. In section III it will be shown that statistical mechanics and the canonical 
ensemble follow naturally from Darwinian dynamics. In section IV the connection to ther- 
modynamics is explored. There it will be shown that the Zeroth Law, the First Law, and 
the Second Law follow directly and naturally from Darwinian dynamics, but not the Third 
Law. In section V two types of simple, but seemly profound, dynamical equalities discovered 
recently are discussed. One is based on the Feynman-Kac formula and one is a generalization 
of Einstein relation. In section VI the range of present ideas is put into perspective. 

Two disclaimers should be made at the beginning of our discussion. First, we will mainly 
be concerned with the theoretical structures, not with specific details. Specifically, we will 
focus on which structural elements should be presented in various equations, where consensus 
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can be reached, not so much as what would be details forms of each elements. In fact, 
many of detailed forms are still unknown and are active research topics. Second, rigorous 
mathematical proofs will be not provided, though care has been taken to make presentations 
as clear and consistent as possible. 



II. DARWINIAN DYNAMICS, ADAPTIVE LANDSCAPE, AND F-THEOREM 

This section summarizes recent results on Darwinian dynamics, in more detail than pro- 
vided in the Introduction. 



A. Stochastic differential equation: the particle and trajectory view 

In the context of modern genetics Darwin's theory of evolution may be summarized ver- 
bally as "the evolution is a result of genetic variation and its ordering through elimination 
and selection". Both randomness and selection are equally important in this dynamical 



process, as encoded into Fisher's fundamental theorem of natural selection and Wright's 
adaptive landscape {0). With an appropriate time scale. Darwinian dynamics may be rep- 



resented by the following stochastic differential equation (jsl; llSl) 



q = f(q) + iV,(q)e(t), (1) 

where f and q are ra-dimensional vectors and f a nonlinear function of q. The genetic fre- 
quency of i-th allele is represented by g^. Nevertheless, in the present paper it will be treated 
as a real function of time t. Depending on the situation under consideration, the quantity 
q could, alternatively, be the populations of n species in ecology, or, the n coordinates in 
physical sciences. All quantities in this paper are dimensionless unless explicitly specified. 
They are assumed to be measured in their own proper units. The collection of all q forms a 
real n-dimensional phase space. The noise ^ is explicitly separated from the state variable 
to emphasize its independence, with / components. It is a standard Gaussian white noise 
function with (^j)^ = , and 

mMt'))i = ^0 6,,6{t-t'), (2) 

and i,j = 1,2,...,/. Here denotes the average over the noise variable {^(t)}, to be 
distinguished from the average over the distribution in phase space below. The positive 
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numerical constant 9 describes the strength of noise. The variation is described by the noise 
term in Eq.([T]) and the ehmination and selection effect is represented by the force f. 

A further description of the noise term in Eq.([T]) is through the n x n diffusion matrix 
D{q), which is defined by the following matrix equation 



iV,(q)iV/(q) = D(q) 



(3) 



where A^j is an n x / matrix, NJ is its the transpose, which describes how the system is 
coupled to the noisy source. This is the first type of the F-theorem (jiol ). a generalization of 
Fisher's fundamental theorem of natural selection ((5|) in population genetics. According to 
Eq. (2) the nxn diffusion matrix D is both symmetric and nonnegative. For the dynamics of 
the state vector q, all that is needed from the noise term in Eq.(l) are the diffusion matrix 
D and the positive numerical parameter 6. Hence, it is not even necessary to require the 
dimension of the stochastic vector C, be the same as that of the state vector q. This implies 
that in general / ^ n. 

We emphasize here that an extensive class of nonequilibrium processes can indeed be 



described by such a stochastic differential equation ()21 



22 



25 



26 



27 



34 



35l ). The current 



research efforts on such stochastic and probability description are ranging from physics 



47f). chemistrv (153 



58|), biology (|l9 



59 



60 



61 



), and other 



541 ). material science (l57l : 
fields (124). 

Darwinian dynamics was conceived graphically by Wright as the motion of the system 
in an adaptive landscape in genetic space (for an illustration, see Fig. 1). Since then such 



a landscape has been known as the fitness landscape in some part of literature (|14J : 1 181 : 



62) 



However, there exists a considerable amount of confusion about the definition of fitness 
111 : [lol ). In the present paper a more neutral term, the (Wright evolutionary) potential 
function, will be used to denote this landscape. The adaptive landscape connecting both the 
individual dynamics and its final destination is intuitively appealing. Nevertheless, it has 
been difficult to prove its existence in a general setting. The major difficulty lies in the fact 
that typically the detailed balance condition does not hold in Darwinian dynamics, that is. 



D ^(q)f(q) cannot be written as a gradient of scalar function (121 
mentioned in the Introduction. 



25 



28 



34 



35l ). already 



During our study of the robustness of the genetic switch in a living organism (1631 : |6J) a 



constructive method was discovered to overcome those difficulties: Eq.(l) can be transformed 
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For the figure, please check the pubUshed version: Emerging of Stochastic Dynamical Equalities 
and Steady State Thermodynamics from Darwinian Dynamics, P. Ao, Communications in 

Theoretical Physics 49 (2008) 1073-1090. 
FIG. 1 Adaptive landscape with in potential contour representation. +: local basin; — : local 
peak; x: pass (saddle point). 

into the following stochastic differential equation, 

[i?(q) + T(q)]q = -V0(q; A) + iV,,(q)e(t) , (4) 

where the noise ^ is from the same source as that in Eq.(l). The parameter A denotes 
the influence of non-dynamical and external quantities. It should be pointed out that the 
potential function may also implicitly depend on 9. The friction matrix -R(q) is defined 
through the following matrix equation 

Nn{c(}NJj{ci) = /?(q) , (5) 

which guarantees that R is both symmetric and nonnegative. This is the second type of the 
F-theorem (jiol ). The F-theorem emphasizes the connection between adaption and variation 



66 



63) 



and is essentially a reformulation of fluctuation-dissipation theorem in physics (165 
and of Fisher's fundamental theorem of natural selection. The connection between Fisher's 
fundamental theorem of natural selection and the fluctuation-dissipation theorem was also 
noticed recently by others (|68|). It should be emphasized here that the F-theorem is not 
confined to the neighborhood of an equilibrium or steady state. It is valid in nonlinear cases 
without detailed balance: There is no reference to potential function in the definition of 
friction matrix R and the anti-symmetric matrix T is in general nonzero. For simplicity 



we will assume det{R) 7^ in the rest of the paper. Hence det(i? + T) 7^ (l30l ). The 
breakdown of detailed balance condition or the time reversal symmetry is now represented 
by the finiteness of the transverse matrix, T 7^ 0. The usefulness of the formulation of Eq.(jl]) 
has already been demonstrated in the successful solution of an outstanding stability puzzle 



in gene regulatory dynamics (l63l : l64j ) and in a consistent formulation of Darwinian dynamics 



(1l9h. Evidently, the Wright adaptive landscape and the F-theorem are the realization of 



chance and necessity in evolution (1691 ). 



The n X n symmetric, non-negative "friction matrix" R and the "transverse matrix" T 
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are directly related to the diffusion matrix D: 

i?(q)+T(q) = 



^(q) + Q(q) ■ 

Here Q is an antisymmetric matrix determined by both the diffusion matrix D{q) and the 



deterministic force fi 



;q) Iso 



70). One of more suggestive forms of above equation is 



[i?(q) + T(q)]D(q)[i?(q) - r(q)] = i?(q) . (6) 

This symmetric matrix equation implies n{n+l)/2 single equations from each of its elements. 
We need another n{n — l)/2 equations in order to completely determine the matrices R and 
T, which will come from the conditions for the potential function. 

The Wright evolutionary potential function 0(q) is connected to the deterministic force 
f (q) by 

-V0(q; A) = [i?(q)+T(q)]f(q). 

Or its equivalent form, 

Vx [[i?(q)+T(q)]f(q)] = 0. (7) 

Here the operation V x on an arbitrary ra-dimensional vector v is a matrix generalization of 
the curl operation for lower dimensions (n = 2,3): (V x v)jj = dvj/dqi — dvi/dqj . Above 
matrix equation is hence antisymmetric and gives the needed n{n — l)/2 single equations 
from each of its elements. From Eq.([6]) and ([7]) the friction matrix, R, the transverse matrix, 
T, and the potential function, 0, can be constructed from the diffusion matrix D and the 
deterministic force f . The boundary condition in solving Eq. (iTl) is implied by the requirement 
that the fixed points of f should coincide with the extremals of the potential function 0. 
The local construction, the construction near any fixed point, was demonstrated in detail in 



Ref. (l30l) . where the connection to the fluctuation-dissipation theorem in physical sciences 



was explicitly demonstrated. For the g^ 



obal construction valid in the whole phase space an 



iterative method was outlined in Ref. (j70|). Some of its mathematical and properties, such 
as the speed of convergence, are not generally known at this moment. 

For the case where the stochastic drive may be ignored, that is, 6 = 0, the relationship 
between Eq.(l) and (jlj) remains unchanged, but Eq.(j4l) becomes deterministic 

[i?(q)+T(q)]q=-V0(q;A). (8) 
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The nonlinear dynamics typical in evolutionary processes is usual explored in the framework 



of game theory (j9|; 



7ll ). The typical mathematical equation is of the form in Eq.(l) without 



noise: q = f(q;A). The universal construction of Lyapunov function in the game theory 
had been an unsolved problem before the present formulation. On the other hand, above 
equation indicates, with the non-negativeness of the friction matrix, 

^0(q;A) = q- V0(q;A) 

= -q-[i?(q)+r(q)]q 



< . 



(9) 



It is clear then that the Wright evolutionary potential function 0(q; A) is a Lyapunov func- 
tion. The deterministic dynamics makes it non- increasing, and it approaches the nearby 



potential minimum to achieve the maximum probability. This is precisely w 



lat was con- 



ceived by Wright. Adaptive dynamics is actively been exploring in biology (jl8 



20). 



The idea of potential function landscape has a long history in biological sciences. Such an 
idea was first proposed in population genetics (jd). It was proposed again in developmental 
biology as a developmental landscape (1721 ). and again in the description of a genetic switch 
in molecular biology (1731 ) . Similar landscape idea was proposed in the ecological evolution 



embedded in the concept of ascendency (1741 ). The landscape has been used not only to 
model neural computation (l75l : 1761 ) . also to understand the protein folding dynamics (1771 ). 
The problem of absence of detailed balance, however, had been previously regarded as an 
obstacle. For example, it was noted that genuine nonequilibrium and asymmetric dynamics 
such as limit cycle might make the construction of the Hopfield potential function in neu- 
ral computation impossible. Recently, it was shown this can be overcome by the present 
formulation (32). 

Conservative Newtonian dynamics may be regarded as another limit of the above formu- 
lation: zero friction limit, where i? = in addition to = 0. Hence, from Eq.(l8]), Newtonian 
dynamics may be expressed as. 



r(q)q=-V0(q;A). 



(10) 



Here the value of potential function is evidently conserved during the dynamics since q • 
V0(q; A) = 0. The system moves along equal potential contours in the adaptive landscape. 
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This conservative behavior suggests that the rate of approaching to equihbrium is associated 
with the friction matrix R, not with the diffusion matrix D. There are situations where the 
diffusion matrix is finite but the friction matrix is zero, and thus the dynamics is conservative 



B. Fokker-Planck equation: the ensemble and distribution view 

It was reasoned heuristically (0) that the steady state distribution p(q) in the state 
space, if exists, is 

p(q, t = cx)) oc e-^<^('i'^) . (11) 

Here (3=1/9. It takes the form of Boltzmann-Gibbs distribution function. Therefore, the 
potential function acquires both the dynamical meaning through Eq.(jl]) and the steady 
state meaning through Eq. ffTTl) . 

It was further demonstrated that such a heuristic argument can be translated into an 
explicit algebraic procedure such that there is an explicit Fokker-Planck equation whose 



steady state solution is indeed given by Eq. lITT]) (1311 ). Starting with the generalized Klein- 
Kramers equation, taking the limiting procedure of the zero mass limit, the desired Fokker- 
Planck equation corresponding to Eq.(jl]) is 

= V-[D(q) + QicDm + V0(q; A)]p(q,t) . (12) 

This equation is equivalent to a statement of conservation of probability. It can be rewritten 
as the probability continuity equation: 

^ + V.j(q.t)=0, (13) 

with the probability current density j defined as 

j(q, t) ^ -[D(q) + g(q)] [^V + V0(q; A)]p(q, t) . (14) 

The reduction of dynamical variables has often been done in the well-known Smoluchowski 
limit. In the above derivation we take the mass to be zero, keeping other parameters, 
including the friction and transverse matrices, to be finite. In the Smoluchowski limit, 
however, the friction matrix is taken to be infinite, keeping all other parameters finite. 
Those two limits are in general not exchangeable. 
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The steady state configuration solution of Eq. (fT2!) is indeed given by Eq. (fTT|) . It is 
interesting to point out tliat tlie steady state distribution function, Eq. ffTT]) . is independent 
of both the friction matrix R and the transverse matrix T. Furthermore, we emphasize 
that no detailed balance condition is assumed in reaching this result. In addition, both the 
additive and multiplicative noises are treated here on an equal footing. 

Finally, it can be verified that above construction leading to Eq. (fT2l) is valid, and remains 
unchanged, when there is an explicit time dependence in i?, T, and/or cj). There may not 
exist a steady state distribution, for example, if the Wright evolutionary potential function 
(p depends on time. 

III. NONEQUILIBRIUM STATISTICAL MECHANICS 
A. Central relation in statistical mechanics 

If we treat the parameter 9{= 1//?) as temperature, the steady state distribution function 
in phase space is indeed the familiar Boltzmann-Gibbs distribution, Eq. ffTT]) . The partition 
function, or the normalization constant, is then 

Z0{\) = J rf"qe-^<^('i'^) . (15) 

The integral / (i"q denotes the summation over whole phase space. The normalized steady 
state distribution is 

g-/3fli(q;A) 

p,(q) ^ . (16) 

For a given observable quantity 0(q), its average or expectation value is 

(0)q = I d"qO(q)p,(q) 

= ^ / rf"qO(q)e-^'^(^'^). (17) 

Zq J 

The subscript q denoted that the average is over phase space, not over the noise in Eq. ([T]) or 
(H]). Eq. (fT7|) is the main fortress of statistical mechanics. Working in statistical mechanics 
then may be classified into two types: conquering the fortress from outside, that is, for- 
mulating as instance of Eq. (fT7|) : and conquering more territory from the fortress, that is, 
applying Eq. (fT7|) . 
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There has been tremendous amount of efforts to derive the canonical distribution of 
Eq.(16) from conservative dynamics. One of the best results is the typicality of such dis- 



tribution for large systems already attempted by Boltzmann (1781 ). On the other hand, all 
experiments have shown a universal validity of Eq.(16) for both large and small systems, 
hence more than typicality. We note that Darwinian dynamics is consistent with such em- 
pirical observations. 

There is a difference in the use of potential function <^ in Eq.(12) and Eq.(15): One is in 
the form of "force" -gradient with respect to the coordinate q, and another is its integration 
which may carry an arbitrary function of the parameter A: 0(q; A) = (f)o{q^; X) + 0i(A). 
For a static parameter, this would not be of any problem: It simply reflects the fact that 
only the difference of the potential function with respect to a given reference is meaningful. 
Nevertheless, if we are going to compare the potential function at two different parameter 
values, 0(q; Ai) and 0(q, A2), connected by a dynamical processes controlled by A(t), such 
an arbitrary function 0i(A) has to be fixed up to a constant. Otherwise, the free energy to 
be discussed in Sec. IV and V would be arbitrary. For a conservative dynamics described 
by Eq.(lO), this function may be determined by a procedure named the minimum gauge 
condition: Assume an adiabatic (slow) process connecting two states specified by Ai and 
A2, and let 5f(q; \(t)) = — V[0(q; A(t)) — 0(q; A = 0)], the force directly controlled by the 
parameter A, the minimum gauge condition to determine 0i(A) may be expressed as 

0i(A2)-0i(Ai) = H^|,^_,^_ , 

and W = /;,(,^,^) 

=Ai,A(t=t2)=A2 c^q" (q; ■^{t))^ that is, the work done in the adiabactic process 
by the external force related to the parameter is equal to the change in potential function, 
a known relation in classical mechanics. 



B. Stochastic processes and the canonical ensemble 

A fundamental question raised by our formulation is this: for a given Fokker-Planck 
equation, can the corresponding stochastic differential equation in the form of Eq.(jl]) be 
recovered (the inverse problem)? That is, is there a one-one correpodence between the 
local and global dynamics connected by a potential function? The answer is yes, and the 
procedure for carrying it out is implicitly contained in Eq. f|T2|) . which will be demonstrated 
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below. 

A generic form for the Fokker-Planck equation is expressed as follows: 

^^ = V^[^^D(q)V-f(qMq,t). (18) 

Here D{q) is the diffusion matrix and f(q) the drift force. The main motivation for such 
a form is simple: In the case detailed balance condition is satisfied, i.e., Q{q} = (and 
T(q) = 0), the potential function (p can be directly inferred from above equation: V0 = 
D ^ f. This makes the diffusion effec very prominent. Any other form of the Fokker-Planck 
equations can be easily transformed into the above form. This generic form of the Fokker- 
Planck equation is less amenable to additional complications such as the noise induced phase 
transitions caused by the q-dependent diffusion constant. 

A potential function 0(q) can always be defined from the steady state distribution. There 



is an extensive mathematical literature addressing this problem (1231 ). After this is done, 
though it can be a difficult problem, the procedure to relate the Fokker-Planck equation to 
Eq. (fT2!) is straightforward. Eq. (fT2|) can be rewritten as 

= V^[^^D(q)V + ^^(V-g(q)) + [D(q) + g(q)] V0(q)]p(q, t) . (19) 

The antisymmetric property of the matrix Q{q) has been used in reaching Eq. (|T9i) . Thus, 
comparing Eq. (|T8l) and (|T9l) . we have 



D{q) = D{q) , (20) 
0(q) = 0(q) , (21) 
f(q) = f (q) - eV^Qici) , (22) 

where we have used the relation 

-[D(q)+g(q)]V0(q)=f(q). 

The explicit equation for the anti-symmetric matrix Q is 

- ^^V-g(q) - [^(q) + g(q)]V0(q; A) = f (q) , (23) 

which is a first order, linear, inhomogeneous, partial differential equation. The solution for 
Q can be formally written as 

Q{^) = -\f c^q'[f (q') + I^(q') VV(q'; A)]e^(^('i^^)-<^('i '^)) + Qo(q)e^<^('»^^) . (24) 
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Here Qo(q) is a solution of the homogenous equation 0'V'^Q{q) = 0, and the two parallel 
vectors in the integrand, ciq' f(q), defines a matrix. This completes our answer to the 
inversion problem. 

It is interesting to note that the shift between the zero's of the potential gradient and 
the drift is given from Eq. (|22l) as, 



Af = _^V"g(q) . 



(25) 



The extremals of the steady state distribution are not necessarily determined by the zero's 
of drift. This shift can occur even when D = constant. The indication for such a shift 



appeared extensive in numerical studies (l79l ). It was also noted analytically (|8( 

Thus, the zero-mass limit approach to the stochastic differential equation is consistent in 
itself. The meaning of the potential, 0, is explicitly manifested in both the local trajectory, 
according to Eq.(jll), and the ensemble distribution, according to Eq. (|T2l) . In particular, no 
detailed balance condition is assumed. There is no need to differentiate between the additive 
and multiplicative noise. This zero mass limit procedure which leads to Eq. f|T2|) from Eq.Q 
may be regarded as another prescription for stochastic integration, in addition to those of 



Ito (jSJ; l35|), of Stratonovich-Fisk (l2ll : ISlI ). and of Hanggi-Klimontovich (l82l : l83l ) . and of 
others (1841 ). They have been discussed from a unified mathematic al p erspective in terms 



of an initial-point, middle-point, and end-point discretization rules (1841 ). All those previous 



methods of treating the stochastic differential equation are mathematically consistent in 
themselves and are related to each other. The connection of the present method to those 
previous methods is suggested by Eqs. (|T8|) and (|T2l) (or Eq. (|T9|) ). For example, Eq.(18) is 



just what can be obtained 



Tom the Hanggi-Klimontovich type treatment, which has been 



noticed by others as well (1851 : l86l ). It is interesting to note that Ito's method puts an 



emphasis on the martingale property of stochastic processes, which may be viewed as a 
prescription from mathematics. The Stratonovich-Fisk method stresses the differentiability 
such that the usual differential chain-rule can be formally applied, which may be viewed as 
the prescription from engineering. The Hanggi-Klimontovich type stresses the generalized 
detailed balance, important in physics. The present approach emphasizes the role played by 
the potential function in both trajectory and ensemble descriptions, as well as the existence 
of a generalized Einstein relation (see below) when the detailed balance is absent. It may be 
regarded as the prescription from natural sciences. All those stochastic integration methods 
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point to the need for an explicit partition between the stochastic and deterministic forces, 
the hallmark of hierarchical structure in dynamics. This feature corresponds precisely to 
the hierarchical law in the evolutionary dynamics of biology ( jl9l ) . 

Two more remarks are in order here. First, by construction the present method preserves 
the fixed points: The fixed points of f are also those of V0. The introducing of the stochastic 
force would not shift the fixed points. This is very useful in that, the results of powerful 
bifurcation analysis of deterministic dynamics can be directly carried over to the stochastic 
situation. Second, there is a one to one correspondence between Eq.(4) and the dynamical 
equation in dissipative quantum phenomena (1871). Because the latter has been discussed in 
context beyond white noise, this connection suggests an immediate generalization of Eq. (4) 
to colored noise situations. 

We may conclude that a stochastic process leads to the canonical ensemble with a temper- 
ature and a Boltzmann-Gibbs type distribution function, independent of how it is treated. 
Other related stochastic ensembles, such as the grand canonical ensemble, may be introduced 
in the same way by including additional constraints. 



C. Discrete stochastic dynamics 



There is another kind of modelling predominant in population genetics and other fields 
which is discrete in phase space and/or time. The existence of potential function in such 
stochastic dynamical systems has been convincingly argued ( l88l : l89l : 190). Here we will not 



discuss it in any detail, and simply quote a few relevant results. The reasons to do so are: 
1) It is known mathematically that any discrete model can be represented exactly by a 



continuous one according to the embedding theorem ([91 



93l ). though sometimes such a 



process may turn a finite dimension problem into an infinite dimension one; 

2) By a coarse graining, averaging process, the discrete dynamics in population genetics can 



often 



3e sinip 



21 



35 
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ified to continuous ones such as diffusion equations or Fokker-Planck equations 



951 ). It is generally acknowledged in population genetics and in other fields 



that the diffusion approximation is often a good approximation. 

For the steady state distribution, all one needs to know is the potential function cj). The 
temperature can be set to be unity: 6=1. Hence, despite possible additional mathemat- 
ical issues, the discrete or continuous representation does not seem to be a physically or 
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biologically important issue. 



IV. STEADY STATE THERMODYNAMICS 



Given the Boltzmann-Gibbs distribution, the partition function can be evaluated accord- 
ing to Eg. (11 51) . Hence, in steady state, all observable quantities are known in principle 
according to Eq. flTTl) . One may wonder then what can we learn about a system from ther- 
modynamics. First, there is a practical value. In many cases the calculation of the partition 
function is hard, if possible. It would be desirable if there are alternatives. Thermodynamics 
gives us a set of useful relations between observable quantities based on general properties of 
the system, such as symmetries. Precise information on one observable can be inferred from 
the information on other observables. Second, there is a theoretical value. Thermodynamics 
has a scope far more general than many other fields in physics. It is the only field in classi- 
cal physics whose foundation and structure not only have survived quantum mechanics and 
relativity, but become stronger. Furthermore, thermodynamics exhibits a sense of formal 
beauty, elegance, and simplicity, which is exceedingly satisfying aesthetically. Its influence 
is far beyond physical sciences, because it is also based on probability and statistics. 

There are numerous excellent books deriving thermodynamics from statistical mechan- 



ics. A thorough treatment can be 



bund, for example, in Ref. (1961 ). A more reader- friendly 



treatment can be found in Ref. ( 1971 ) or (l98l ) . Concise and elementary treat men ts from ther- 



modynamics point of view have been presented in Ref. (j99l ) and in Ref. (llOCIl) . A m odern 
discussion of the approaching to the steady state was presented in Ref. (llOll ). Ref. (1 1021 ) 
gave a comprehensive review from the point of view steady state thermodynamics, but "tem- 
perature" was de-emphasized. The present demonstration overlaps with it at various places. 
Nevertheles s, th ere is one main difference: The role of "temperature" is explicitly discussed 
here. Ref. ( lOsI ) gave a detailed discussion of the connection between thermodynamics and 
Langevin dynamics with an emphasis on detail balance and on the stochastic integration of 
Stratonovich. The above demonstration already indicates that there is no need to confine 
to Stratonovich approach. 

The principal objective in this section is to show that Darwinian dynamics indeed implies 
the main structures of thermodynamics, even though at a first glance it seems to have no 



connection, because Darwinian dynamics is at the extreme end of nonequilibrium processes. 
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In the light of those superb expositions mentioned above, the present discussion may appear 
incomplete as well as arbitrary. For a systematic discussion on thermodynamics the reader 
is sincerely encouraged to consult those books and/or any of her/his favorites. Nevertheless, 
we wish to show that a logically consistent dynamical understanding of thermodynamics 
can be obtained. Specifically, it is explicitly demonstrated that absence of detailed balance 
condition does not prevent us to obtain thermodynamics. 

A. Zeroth Law: existence of absolute "temperature" 

From Darwinian dynamics, the steady state distribution is given by a Boltzmann-Gibbs 
type distribution. Eg. (ITT]) , determined by the Wright evolutionary potential function of the 
system and a positive parameter 9 of the noise strength. Hence, the analogy of the Zeroth 
Law of thermodynamics is implied by Darwinian dynamics: There exists a temperature-like 
quantity, represented by the positive parameter 6. This "temperature" is "absolute" in 
that it does not depend on the system's material details. It is evident that the existence 
of the "temperature" is a direct consequence of stochasticity in Darwinian dynamics, as 
exemplified in Eqs.(l-6). 

B. First Law: conservation of "energy" 

1. Fundamental relation and the differential forms 

From the partition function Zg, we may define a quantity 



Fo = -einZ. 



(26) 



We may also define the average Wright evolutionary potential function. 




(27) 



From the distribution function we may further define a positive quantity 




(28) 



It is then straightforward to verify that 



Fe = Ue 



es, 



e 



(29) 
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precisely the fundamental relation in thermodynamics satisfied by free energy, Fg, internal 
energy, Ue, and entropy, Sg. The subscript 9 denotes the steady state nature of those 
quantities. Due to the finite strength of stochasticity, that is, 9 > 0, not all the Ug is readily 
usable: Fg is always smaller than Ug. A part of 9 Sg called "heat" cannot be utilized. 

It can also be verified from these definitions that if the system consists of several non- 
interacting parts, Fg, Ug, and Sg are sum of those corresponding parts. Hence, they are 
extensive quantities. The "temperature" 9 is an intensive quantity: it must be the same for 
all those parts because they are contacting the same noise source. Therefore, we conclude 
that the First Law of thermodynamics is implied by Darwinian dynamics. 

The fundamental relation for the free energy, Eq. fl29p . as well as the internal energy, 
Eq. fl271) . may be expressed in their differential forms as well. Considering an infinitesimal 
process which causes changes in both the Wright evolutionary potential function via pa- 
rameter A and in the steady state distribution function, the change in the internal energy 
according to Eq. (l27|) is 

dUg = I rq_ d\ pgiq) + I rf"q 0(q; A) dpg{q) 

= ixd\ + 9dSg . (30) 

This is the differential form for the internal energy. Here the steady state entropy definition 
of Eq. (l28!l has been used, along with / li^q dpg{q) = 0, and 

dUo 



(31) 



dX 

Eq. (l30l) can be written in the usual form in thermodynamics: 

dUg = dW + dQ . 

The part corresponding to the change in entropy is the "heat" exchange: dQ = 9 dS and 
the part corresponding to the change in the Wright evolutionary potential function is the 
"work" dW = p dX. The conservation of "energy" is most clearly represented by Eq. (l30l) . 
For the free energy, following Eq. (l30|) and (!29l) the differential form is 

dFg = dUg - d9 Sg - 9dSg 

= pdX-Sgd9. (32) 
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2. Steady state thermodynamic definition of temperature 



Eq. (l30|) and (132!) may be useful in some applications. For example, the "temperature" 
can be found from Eq. flHUl) : 



e 



dUo 



dSe 



(33) 



There are situations in which an effective tmeprature may be needed ( ll04l ). Eq.(33) may be 
then u sed t o find the "temperature" in a nonequilibrium process if it cannot be identified a 
priori ( lOsI ). 

The convexity of a thermodynamic quantity is naturally incorporated by the Boltzmann- 
Gibbs distribution. There is no restriction on the size of the system. Even for a finite 
system, however, phase transitions can occur, because singular behaviors can be built into 
the potential function, and controlled by external quantities. 



C. Second Law: maximum entropy 

1. Second Law and Carnot cycle 

First, we remind the reader of a few important definitions. 
A reversible process is such a process that all the relations between quantities and parameters 
are defined through the Boltzmann-Gibbs distribution, Eq. ffTT]) . From Darwinian dynamics 
point of view, a reversible process in reality is necessarily a slow or quasi-static process in 
order to ensure the relevancy of steady state distribution for its realization. 
An isothermal process is a reversible process in which "temperature" 9 remains unchanged, 
9 = constant. Do not confuse this with thermostated processes, which are, in general, 
nonequilibrium dynamical processes. 

A reversible adiabatic process is a reversible process in which the coupling between the system 
and the noise source is switched off and the system varies in such a way that the distribution 
function remains unchanged along the dynamic trajectory at each point in phase space. The 
corresponding "temperature" can be restored at any position during such a process. This 
implies that the entropy remains unchanged, Sg = constant. Then an irreversible adiabatic 
process is one that there is no coupling between the system and the noise environment. The 
system dynamics is deterministic and conservative. 
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For the figure, please check the pubbhshed version: Emerging of Stochastic Dynamical Equalities 
and Steady State Thermodynamics from Darwinian Dynamics, P. Ao, Communications in 

Theoretical Physics 49 (2008) 1073-1090. 
FIG. 2 Carnot cycle, (a) The /x — A representation, (b) The 9 — S representation. In this 
temperature-entropy representation, the Carnot cycle is a rectangular. 

The Carnot cycle, on which the Carnot heat engine is based, is a fundamental construction 
in classical thermodynamics. The Carnot cycle consists of four reversible processes: two 
isothermal processes and two reversible adiabatic processes (Fig. 2.a,b). The efficiency v of 
the Carnot heat engine is defined as the ratio of the total net work performed over the heat 
absorbed at high temperature: 

total 

The total net work done by the system is represented by the shaded area enclosed by the 
cycle. For the heat absorbed at the high isothermal process 1^2, 

AQi2 = 9high^Se,i2 . (35) 

For the adiabatic process 2 — > 3, an external constraint represented by A is released (or 
applied) , 

A5,,23 = , AQ23 = . (36) 
For the heat absorbed (rather, released) at the low isothermal process 3 — 4, 

AQ34 = 9iow^Se,M = — AQ43 • (37) 

For the adiabatic process 4 — > 1, an external constraint is applied (released), 

A^9,4i = , AQ41 = . (38) 

Using the First Law, Eq. fl29|) and the fact that the free energy is a state function 

AFtota/ = AQtotal — 'AWtotal 

= . (39) 

The minus sign in front of the total work represents that it is the work done by the system, 
not to the system. The total heat absorbed by the system is 

AQtotal = AQ12 + Ag34 = Agi2 - AQ43 = AWtotal ■ 
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We further have 



(40) 



From Eq.(34), (39) and (40) the Carnot heat engine efficiency is then 



u = l- 



^Qa3 



1 - 




(41) 



^high 



precisely the form in thermodynamics. The Second Law of thermodynamics may be stated 
as that for all heat engines operating between two temperatures, Carnot heat engine is the 
most efficient. The Second Law is thus implied by Darwinian dynamics. 

The beauty of Carnot heat engine is that its efficiency is completely independent of any 
material details. It brings out the most fundamental property of thermodynamics and is 
a direct consequence of the Boltzmann-Gibbs distribution function and the First Law. It 
reveals a property of Nature which may not be contained in a conservative dynamics, at least 
it is still not obviously to many people from Newtonian dynamics point of view after more 
than 150 years of intensive studies (j41i ). On the other hand, it appears naturally implied in 
Darwinian dynamics. 

Having discussed various thermodynamics processes, let us return to the issue of fixing 
the arbitrary function in potential function discussed in Subsec. III. A, which is now directly 
connected to free energy. The minimum gauge condition to determine 0i(A) may be extended 

as 



with W = dq ■ 5f (q; A(t)), that is, the work done in the reversible process by the ex- 
ternal force related to the parameter is equal to the change in free energy. Again, it is an 
accepted relation in statistical thermodjTiamics. It is possible that that 0i(A) determined 
thermodynamically may depend on temperature. 

2. Maximum entropy principle 

There are many versions of the Second Law. Here we refer to two equivalent versions 
from the stability point of view, which frame the discussion in this subsection. 



Fe{X2) ~ Fg{Xi) = {W)\ 



reversible ' 
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Minimum free energy statement: Given the potential function and the temperature, 
the free energy achieves its lowest possible value if the distribution is the Boltzmann-Gibbs 
distribution. 

Maximum entropy statement: Given the potential function and its average, the entropy 
attains its maximum value when the distribution is the Boltzmann-Gibbs distribution. 

The latter version of the Second Law is the most influential. Its inverse statement, the 
so-ca lled maximum entropy principle, has been extensively employed in proba bility inference 



( 11061 ) both within and beyond the physical and biological sciences (11071 : llOSi ). 

We generalize here the definitions of the entropy to include the arbitrary time-dependent 
distribution in analogy to Eq.( 



S{t)^- |ci"qp(q,t) lnp(q,t). (42) 

There are two apparent drawbacks to such a definition, however. First, even if the evolution 
of the distribution function p(q, t) is governed by the Fokker-Planck equation, Eq.( |T2i) . in 
general the sign of the time derivative, dS{t)/dt = S{t), cannot be determined, whether or 
not it is close to the steady state distribution. Though S{t) might indeed be divided into 
an always positive part and the rest, such a partition usually appears arbitrary. Even more 
problematically, in general S{t) can be either larger or smaller than Sg, which makes such 
a definition lose its appeal in view of the maximum entropy statement of the Second Law. 
We will return to S(t) later. 

Nevertheless, if we take the lesson from the potential function that only the relative value 
is important, we may introduce a reference point in functional space into a general entropy 



definition. One previous definition for the referenced entropy is (l65l ) 

p(q, t) 



Sr{t) = - fd^'q p(q, t) In + Se . (43) 

With the aid of the inequality ln(l + x) < x and the normalization condition / (i"q p(q, t) = 
J (i"q P6i(q) = 1, it can be verified that 

SAt) = J d"q p(q, t) m (i + ''^""l^J^^'^ ) + s, , 

< / d-q{pe{q)-piq),t) + Se, 

= Se . (44) 
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The equality holds when p(q, t) = P6»(q)- This inequality is independent of the details 
of the dynamics and is evidently a maximum entropy statement. Furthermore, with the 
aid of the Fokker-Planck equation, Eq. fll2p . the time derivative of this referenced entropy, 
dSr{t)/dt = Sr{t) is always non-negative: 

SAt) = -/rf"q^4^1n^^^'^) 



dt pg{q) 
= - frq (V-[Z}(q) + Q(q)][^V + V0(q;A)Hq,t)) In 

= [d-q (vin^^^) [D(q) + g(q)][^V + V0(q;A)]p(q,t) 

= I rf"q^7^([^V + V0(q;A)]p(q,t)r[/^(q) + g(q)][^^V + V0(q;A)]p(q,t) 

= /rf'^q^7^Tr(q,^)^(q)j(q,^) 

> . (45) 

Hence, this referenced entropy Sr{t) has all the desired properties for the maximum entropy 
statement of the Second Law. 

Two important remarks are in order. First, in the derivation reaching Eq.(45), the 
dynamics responsible for breaking the detailed balance condition, the anti-symmetric matrix 
Q, does not contribute to the change of relative entropy. Only the dissipative part of 
dynamics represented by D leads to the monotonic change of relative entropy. Given the 
present interpretation from both trajectory and ensemble points of view, it is clea r tha t Q is 



what needed for the Poisson bracket in conservative dynamics explored elsewhere (Il09l ). The 
present demonstration suggests a unified treatment for both near and far from equilibrium 
dynamical processes. 

Second, by the probability current density definition of Eq.([T3j) j is zero at the steady 
state. This is in accordance with the understanding that at equilibrium there is no change 
in (relative) entropy, that is, the entropy production should be zero at equilibrium. Now, 
we have generalized this conclusion to steady state. We note that the present probability 
current density may differ from the usual probability current density definition which may 
be based on Eq. (|T8l) and takes the form j(q, t) = — [ODV — f (q)]p(q, t), which is not zero at 
the steady state. Instead, V • j = at the steady state. Even with the usual definition, the 
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zero relative entropy production at steady state always remains valid. 

Though the definition of entropy of Eq. fH2l) may not be appealing, a related definition 
of free energy is consistent with the Second Law. We demonstrate it here. First, a general 
definition for the internal energy may be: 

U{t) ^ J rf"q 0(q; A) p(q, t) . (46) 

Given the distribution and the potential function, quantities defined in Eq. and (jlSD can 
be evaluated. Following the form of Eq. (l26|) a general definition of free energy would be, 
with the "temperature" 9, 

F{t) = U{t) - e S{t) . (47) 

It can be verified that F{t) > Fg and its time derivative is always non-positive, F{t) < 0. 
So defined time dependent free energy indeed satisfies the minimum free energy statement 
of the Second Law. It differs from the referenced entropy Sr{t) by a minus sign and by a 
constant: 

F{t) = -9Sr{t) + Ug . 

The generalized entropy S(t) has one desired property regarding to the adiabatic processes 
(either reversible or irreversible) in that D = during the adiabatic process. Hence, 

S{t) = -|d"q|^(q,t) lnp(q,t) 

= -Jrci [W Q(q) V0(q; A)p(q,t)] lnp(q,t) 

= -|rf"q [(Q(q) V0(q;A))-V] f^^'^ dp'lnp' 

= . {adiabatic) (48) 

This is the known result in conservative Newtonian dynamics that the entropy remains un- 
changed. In deriving the above equation we have used two properties: 

1) the no-coupling to the noise environment has been translated into the fact that the terms 
associated with the diffusion matrix D and "temperature" 6 are set to be zero in Eq. f|T2l) . 
because they are related to the noise source which is decoupled during an adiabatic process; 
and 

2) the incompressible condition of V ■ [Q(q) V</'(q; A)] = 0, the Liouville theorem, which is 
typically satisfied in Newtonian dynamics. 

In this conservative case, it can be verified that Sr{t) = 0, too, for any adiabatic process. 
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Nevertheless, it is possible that while the dynamics is conservative, R = 0, and even satisfy- 
ing the Jacob identity in classical mechanics, the Liouville theorem can be violated. Hence, 
in this case the general entropy S{t) is not a constant during the dynamical process, and 
the general free energy F{t) and the referenced entropy Sr{t) are not well defined either, 
because there is no "temperature" to de fine a steady state distribution. But the "energy" 
can be conserved during such a process (IIOQI ). 



3. Connection to information theories 



It may be worthwhile to define another referenced entropy Sr2{t) which approaches the 
steady state entropy Sg from above. It's form is simple: 



Sr2{t) 



c?"qp0(q) lnp(q,t) . 



(49) 



It can be verified that Sr2it) > Se and 5^2 (i) < 0. 

The relation define d by Eq. (1431) is in the same form as the relative information in infor- 



mation theories. Ref. (jlld ) contains discussions of many other use: 



complete coverage of information theory can be found in Ref. (11 081 



ul in equalities. A rather 
and some current 



discussions of its connection to thermodynamics can be found in Ref. (jllll ) and (11121 ). 



D. Third Law: unattainability of zero "temperature" 

Now we consider the behavior near zero "temperature", ^ 0. To be specific, we 
assume the system is dominated by a stable fixed point, taking as q = 0. As suggested by 
the Boltzmann-Gibbs distribution, Eq. (|TTl) . only the regime of phase space near this stable 
fixed point will be important. Hence the Wright evolutionary potential function can be 
expanded around this point: 

1 " 

0(q;A) = 0(O;A) + -5:A;,(A)g| . (50) 

3=1 

Here we have also assumed that the number of independent modes is the same as the 
dimension of the phase space, though it may not necessary be so. This assumption will not 
affect our conclusion below. Those independent modes are represented by qj without loss of 
generality. The "spring coefficients" {kj} are functions of external parameters represented 
by A. 
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The partition function according to Eq. (fT5!) can be readily evaluated in this situation: 

n 



27r^ 



So, the entropy according according to Eq. (l28|) . is: 



(51) 



So 



n 



e--ine 

2 



I 1 
2 4" 277 ■ 



(52) 



The first term does not depend on external parameters, but the second term does. This 
suggests that the entropy depends on the specific control process to achieve low temperature: 
different processes would lead to different sets of {kj}, hence a difference between entropies at 
low temperatures. The Third Law states that in the limit of zero temperature the difference 
in entropy between different processes is zero. Thus, Darwinian dynamics as formulated in 
the present paper does not imply the Third Law. 

One should not be surprised by the above conclusion, because Darwinian dynamics here is 
essentially "classical". The same conclusion could also be reached from classical Newtonian 
dynamics. This means that within Darwinian dynamics one could easily conceive the zero 
"temperature" limit without any logic inconsistency. 

With quantum mechanics, the agreement to the Third Law is found and a stronger 
conclusion is reached: Not only the difference in entropy should be zero, the entropy itself is 
zero at zero temperature. We may conclude that, in general, completely neglecting the noise 
is not a viable choice: The t empe rature cannot be zero. When the noise is small enough, 
new phenomena may occur (jll3l ). Phrasing differently, there appears to exist a bottom 
near which there is something. It should be pointed out that in the present formulation 
of Darwinian dynamics, particularly the Eq.(jll), the existence of an anti-symmetric matrix 
suggests a natural route to define a Poisson bracket. Therefore, it is possible to extend 
Darwinian dynamics into the quantum regime by following the usual canonical quantiz ation 



proc edure, possibly following the suggestions from dissipative quan tum dyna mics (ISTl : 



llSl ). Studies show that the Third law can be regained in this way (1116 : 



114 



1171 ). 



E. Two inferences 



To summarize, in this section we have shown that except for the Thi rd L aw, all other 
Laws of thermodynamics follow from Darwinian dynamics. The concern (jl03l ) as to which 
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stochastic integration method, Ito, Stratonovitch-Fisk, Hanggi-Khmontovich, or others, is 
consistent with the Second Law is resolved: Any of them can be decomposed into three 
parts: the conservative dynamics represented by the antisymmetric matrix Q, and non- 
conservative dynamics represented by nonnegative symmetric matrix D, and the potential 
function 0. Thus, any of them is consistent with the Second Law. We also note that based on 
thermodynamic relations, the fundamental relation of Eg. (1291) . the conservation of energy of 
Eq. fl30l) . the universal heat engine efficiency of Eq. pTl) . supplemented by the additive nature 
of extensive quantities and the temperature of Eq. (l33|) . the Boltzmann-Gibbs distribution 
is implied. In this way statistical mechanics and thermodynamics are equivalent. 

Thermodynamics deals with steady state properties. The key property is determined by 
the Boltzmann-Gibbs distribution of Eq. flTTl) which only depends on the Wright evolutionary 
potential function and the "temperature" 9 of Darwinian dynamics. The rest relations 
are determined by the various symmetries of the system. No dynamical information can be 
inferred from them. This feature has been noticed in the literature (1371 ). In particular, there 
is no way to recover the information on two quantities determining the local time scales, the 
friction matrix R and the transverse matrix T, from thermodynamics. In this sense "time" 
is lost in thermodynamics. Thus, thermodynamics contains no direction of time and hence 
is consistent with the time-reversal conservative Newtonian dynamics. 



V. STOCHASTIC DYNAMICAL EQUALITIES 

We have explored the steady state consequences of Darwinian dynamics in statistical 
mechanics and in thermodynamics. In this section we explore its general dynamical conse- 
quences. Two types of recently discovered dynamical equalities will be discussed: one based 
on the Feynman-Kac formula and other a generalization of Einstein relation. For a back- 
ground on path integral formulation, Feynman's lucid exposition is highly recommended 



A. Feynman-Kac formula 

Previous discussions demonstrate that the Boltzmann-Gibbs distribution plays a domi- 
nant role. It is natural to work in a representation in which Boltzmann-Gibbs distribution 
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appears in a most straightforward manner, or, as close as possible. The standard approach 
in this spirit is as follows. First, choose the dominant part of the evolution operator L. The 
remaining part is denoted as 5L. In this subsection a general methodology to carry out this 
procedure is summarized. 

The Fokker-Planck equation, Eq. fll2l) . can be rewritten as 

^p(q,t) = L(V,q;A)p(q,t), (53) 

with L = V^[D{q) + Q(q)][6'V + V(f){q)]. It's solution can be expressed in various ways, 
he most suggestive form in the present context is that given by Feynman's path integral 



(jllSl ): If at time t' the system is at q', the probability for system at time t and at q is given 



by summation of all trajectories allowed by Eq.(jl]) connection those two points: 

7r(q, t- q', f)= \ q(^) = ^(^0 = ■ (54) 

trajectories J 

In terms of the summation over the trajectories, the solution to Eq.( l53i) (and Eq.( fT2|) ) may 
be expressed as 

p(q,t) = y'rf"q'vr(q,t;q',t')p(q',^ = 0) 

= (5(q(t)-q))|,™,-,,,„,, . (55) 

The delta function 5(q(t) — q) is used to specify the end point explicitly. There is an 
additional summation over initial points, q', weighted by the initial distribution function, 
p(q',t = 0). 

Now, considering that the system is perturbed by SL{q; A), represented, for example, by 
a change in control parameter A. The new evolution equation is 
d 

g^Pnew{(l, t) = [L(V, q; A) + 5L(V, q; A)]p„e«;(q, t) . (56) 

The perturbation may act as a source or sink for the probability distribution. The probability 
is no longer conserved: ^in general / dq Pnew{<i,t) 7^ J dq Pnew{(l,t = 0). According to the 
Feynman-Kac formula (24), the solution to this new equation can be expressed as 

PneM,t) = (5(q(t) - q) e/;'^*'^^«^(*')-(*');A)\ , (57) 

\ / trajectory 

with Pne«)(q', t = 0) = p(q', t = 0) and the trajectories following the dynamics of Eq.Q, the 
same as that in Eq. (l55|l . Thus, the evolution of the distribution function under new dynamics 
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can be expressed by the evolution in the original dynam ics. The corresponding procedure in 
quantum mechanics is that in the "interaction picture" (jllOl ). Eq. fl57|) is a powerful equality. 
Various dynamical equalities can be obtained starting from Eq . (lFr|l . Indeed, its direct and 



indirect consequences have been extensively explored (1120 



ml) 



B. Free energy difference in dynamical processes 



1. Jarzynski equality 



We have noticed the special role played by the Boltzmann-Gibbs distribution, Eq. (fTT!) . 
In particular, it is independent of the friction and transverse matrices R, T. Evidently the 
instantaneous Boltzmann-Gibbs distribution with X = X{t) is 



[q;A(t)) 



-/30(q;A{t)) 



(58) 



Mm) ■ 

Here we have explicitly indicated that the parameter A is time-dependent. This distribution 
function is no longer the solution of the Fokker-Planck equation of Eq. (fT2|) . however. There 
will be transitions out of this instantaneous Boltzmann-Gibbs distribution function due to 
the time-dependence of the parameter A. While such transitions may be hard to conceive 
of in classical mechanics, they can be easily rationalized in quantum mechanics, because 



of the discreteness o 



transition (1114 



122 



states. One such well studied model is the dissipative Landau-Zener 



123h . 



An interesting question is that whether the transitions can be "reversed" such that the 
instantaneous distribution is indeed an explicit solution for another but closely related evo- 
lution equation. This means that the original Fokker-Planck equation has to be modified in 
a special way to become a new equation. Indeed, this modified evolution equation can be 
found for any function p(q, t), which reads. 



— 



L(V,q,t) 



1 



-(L(V,q,t)p(q,t)) + 



'ain|p(q,t)r 



Pv 



It can be verified Pnew{(l,t) = p(q, t) is a solution of above equation. Treating 



(q,t). (59) 



5L 



-L(V,q,t)p(q,t) 



d\n\p{q,t)\ 



p(q, t) dt 
and the Feynman-Kac formula Eq. (l57p may be applied. The analogous procedure has been 

well studie d for transitio ns during adiabatic processes in interaction picture of quantum 



mechanics ( 11141 : Ill9l ; Il23l ) and of statistical mechanics (jllSl ) 
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Now, let p be the instantaneous Boltzmann-Gibbs distribution of Eg. (158|) : p 
We have 



(q;A(t)). 



5L 



.90(q;A) 



Eq. (l59l) can be solved by summing over all trajectories using the Feynman-Kac formula, 
Eg. (1571) . At the same time, we know the instantaneous Boltzmann-Gibbs distribution of 
Eg. ( l58i) is its solution. Since these two are solutions to the same eguation, we have following 
eguality 

(60) 



trajectory 



Following Ref. (11241 ) we define the dynamical work along a trajectory as 



t .^^^^ g0(q(f);A(tO) 

^^^^ dx 



(61) 



The eguality between the free energy difference AFg = Fg(t) — Fq{0) and the dynamical 
work Wx is, then, after summation over all final points of the trajectories in Eg. (1601) . 



trajactory 



(62) 



This elegant eguality connects the steady state guantities AFg to the wor k do ne in a dy- 
namical process. Such parametrized form was first discovered by Jarzynski ( 1l24l ). It should 
be emphasized that there is no assumption of steady state state at time t for the system 



governed by Eg. (1121) . In fact, it is kno wn, 



'or example, in the case of the Landau-Zener tran- 



sition that it is not steady state (Ill4l : Il23l ). T his equality has been discussed and ext ended 



1261 : 



127 



128 



129 



130 



131 



132|). The 



by various authors from various perspectives (1125 : 
connection of this eguality to the Feynman-Kac formula was first explicitl y po inted out in 
Ref. (1l26l ). There have also been experimental verifications of this eguality (1l33l ). This type 
of egualities was reviewed recently (11341 ). 

Three remarks may be made here. First, the derivation of Jarzynski eguality presented 
here is valid both with and without detailed balance condition, with both additive and 
multiplicative noises. It has only one result. Second, for Jarzinskii eguality, neither D nor 
Q enter into the eguality, while the dynamics are obviously determined by those matrices. 
Third, Feynman-Kac formula may be used to generate more dynamical egualities, as already 
noted. 

In the light of those observations, we may infer three immediate but somewhat surpris- 
ing physical results. First, the "temperature" can be time dependent, too. Thus, a work 
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equality for "temperature" can be established by explicitly going through the procedure, 
hence extends the work relation to a different dynamical domain. Second, the validity of 
the demonstration of Jarzynski equality does not depend on the details of the operator L in 
Eq.(53), as long as the steady state exists. This would suggest that color ed noises can be 



entered into Eq.(53). In fact, we already know such examples (jSTi : Ill4j : Il23l ). The dynamical 
equation equation as expressed by Eq.(4) also allows a straightforward extension to colored 
noises. Third, given the potential function determined by a reversible pro cess discussed in 



Sec. IV.C.l and that using Feynman-Kac formulae we have (1120 



135 



1361 ) 



(exp{-(Ty-WA)})| 

trajectory 

exp 



ciq-(5f(q(t');A(ti))+ / dt' X{t')dx<PHt')-\{t')) 

Jo 



trajectory 



Jarzynski equality may be used to check consistency in our understanding of related dy- 
namical quantities. For example, a discrepancy may indicate possibly a missing term in the 
potential function 0. 

2. Microcanonical and canonical ensembles 



The Jarzynski equality places the Boltzmann-Gibbs distribution hence the canonical 
ensemble in the central position. They are simply natural consequences from Darwinian 
dynamics. However, if we start from conservative, Newtonian dynamics, the appropriate 
ensemble is the microcanonical ensemble. Any distribution function which is a function of 
the potential function or Hamiltonian would be the solution of the Liouville equation. From 
this point of view the Boltzmann-Gibbs distribution and the associated temperature appear 
arbitrary: It is just one among infinite possibilities. This concern has been raised in the 
literature (11371 ) regarding to the generality of the equality of Eq. (l62|) . No satisfactory treat- 
ment of this concern within Newtonian dynamics has been given. Rather, it has been an 
"experimental attitude": If one does this and makes sure the procedure is correct one gets 
that, and it works. Darwinian dynamics, however, provides an a pnon reason to fully justify 
the use of the Boltzmann-Gibbs distribution in the derivation of the Jarzynski equality. 
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C. Generalized Einstein relation 



In deriving the Boltzmann-Gibbs distribution from Darwinian dynamics, Eq.([6]): 

[i?(q) + T(q)] D(q) [i?(q) - T(q)] = i?(q) , 

has been used. This general and simple dynamical equality was termed the generalized 
of Einstein relation (1701 ) . If the detailed balance condition is satisfied, that is, if T = or 
Q = 0, the above relation reduces to RD = 1, which was discovered a century ago by Einstein 
(11381 ). and since then has been known as Einstein relation. Variants of E instein relat ion i n 
different setti ngs w ere obtained earlier a nd i ndependently by Nernst (jl39l ). by Planck (jl40l ). 
by Townsend (1l4ll ). and by Sutherland (1l42l ). Similar to the dynamical equality exemplified 
by Jarzynski equality, the generalized Einstein relation is a consequence of the Boltzmann- 
Gibbs distribution and the canonical ensemble embedded in Darwinian dynamics. 

Experimentally, all those quantities in Eq.([6]) can be measured independently. Hence, 
this generalized Einstein relation should be subject to experimental tests in the absence 
of detailed balance, that is, when the antisymmetric matrix T does not vanish. While 
in evolut„ p.oce.e= m b.o.ogy the data can be o.gan^ed by the present dynanncal 
structure (8% the parameters are typically fixed by Nature. We need situations where all 
these elements, R, T, 0, 9, are accessible to experimental control. 

For simplicity, we consider a nonequilibrium situation realizable with current technology 
as an illustration: a charged nanoparticle or macromolecule, an electron or a proton, with 
charge denoted by e, in the presence a strong, uniform magnetic field B and immersed 
in a viscous liquid with fr ictio n coefficient rj. Indeed, similar situation has already been 
considered experimentally (11431 ). Here we restrict our attention to the two dimensional case 
{n = 2). The corresponding Darwinian dynamical equation of Eq.(jl]) in this case is the 



Langevin equation with the Lorentz force for a "massless" charged particle (1l44j ): 



The friction matrix is 



The transverse matrix is 



rjq H — Bz x q 

c 



R 



-V0(q)+iV,,eW 




(63) 



(64) 



(65) 
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and the "temperature" is ^ = kBTsG, with the Boltzmann constant ks and the thermal 
equihbrium temperature Tbg- If the system is out of thermal equilibrium, the effective 
temperature, such as defined by Eq.(j2S]), should be used. This is a phy sically realizable sit- 
uation in two dimensional electrons extensively discussed recently (jl45l ). The corresponding 
Fokker-Planck equation, following Eq. fll2p . is 

dpiq, t) 



dt 



V[D^ V+[Z^ + Q]V0(qMq,t) 



(66) 



This is precisely a diffusion equation with diffusion matrix D. Both D and Q can be obtained 
from the generalized Einstein relation, Eq.Q: 

D = '—^ 1 (67) 



Q 




(68) 



In a typical situation, though all quantities can be measured experimentally, the friction 
coefficient is likely to be less sensitive to the magnetic field. Then one may need to focus 
experimentally on the diffusion in the presence of the magnetic field without any potential 
field. In this case the evolution of the distribution is governed by the standard diffusion 
equation: 



with 



dpjq, t) 
dt 



di 



(69) 



The solution to Eq. (l69l) with p(q, t = = 6c[(t = 0) — q is standard (two dimension, n = 2): 



p(q, t) 



exp 



27r t [ 2dB9 t J 
Averaging over trajectories governed by Eq.(l69l), (q(t) - q(t = ^))\trajectory 



and 



;q(t) - q(t = 0))^ 



AdeO t . 



trajectory 

An experimental system, for example, may be that of injection of electrons into a semicon- 
ductor, wherein one measures their diffusion in the presence of a magnetic field. Every quan- 
tity in the generalized Einstein relation of Eq. ([6]) can be measured and controlled experimen- 
tally. Another experimental system may be on ionized hydrogen or deuterium. For charged 
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macromolecules and nano-particles, the friction coefficient may be too large to allow a mea- 
surable magnetic field effect accessible by current magnets. As a numerical example, for the 
zero magnetic field diffusion constant of dB=okBTBG ~ 10^ cm? / sec, which implies diffusing 
of about 100cm in 1 second, the friction coefficient isrj = l/dB=o ~ 4 x 10~^^dyne/{cm/sec) 
at temperature Tbg = 3007^. Assuming one net electron charge, for magnetic field 
B = 1 Telsa , we have eB/c ~ 1.6 x l{)~^^dyne/ {cm/ sec), comparable to the friction 
coefficient. 



VI. OUTLOOK 

In the present paper we have presented statistical mechanics and steady state thermo- 
dynamics as natural consequences of Darwinian dynamics. Two types of general stochastic 
dynamical equalities have been explored. Both can be directly tested experimentally. Ev- 
erything appears fully consistent except for one issue. The point of view in physics has 
been that we should start from conservative dynamics, not Darwinian dynamics. This view 
has indeed strong experimental and historical supports during past 150 years. It is still the 
subject of current research (41; 42; 4^; ItsI ). The troubling issue may be expressed by an at- 
tempt to answer the following question. The natural consequence of conservative dynamics 
is the micro-canonical ensemble, from which the canonical ensemble just appears to be one 
of its infinite possibilities. How and why does Nature choose the canonical ensemble and 
the Second Law? There does not seem to be a consensus yet on the answer. 

The difficulty in reaching the Second Law from conservative dynamics in nonequilibrium 
setting may encourage us to consider Darwinian dynamics. There is, however, a more 
compelling reason: Darwinian dynamics is the most fundamental and successful dynamical 
theory in biological sciences. Furthermore, as we have demonstrated above, the Second Law 
and other nonequilibrium properties follow naturally from it. Logically it provides a simple 
starting point. It must contain a large element of physical truth. 

Conservative dynamics and Darwinian dynamics appear to occupy the two opposite ends 
of the theoretical description of Nature. Both have been extremely successful. In many 
respects they appear to be complementary to each other. For example, it was noticed 
that Darwinian dynamics and Newtonian dynamics can be derived from each other under 
appropriate conditions (jiol ). What would be the implication of this mutual reduction? 
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Are there hidden reasons for such complementarity? Hints to answers f or such q uestions 



are perhaps aheady contained in the discussions of "more is different " ( 1461 : 11471 ). of the 
immensity of f unct ional space (Il48l ) , of the macroscopic quantum effect ( 1871 ) , and of universe 
vs multiverse (jl49l ). The formulation and analysis in this paper may provide insights into 
those fundamental relationships and a stimulus for further studies. 
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